Radiologists and Clinical Trials: Part 2: Practical Statistical Methods for Understanding and Monitoring Independent Reader Performance.

Though many clinical trials rely on medical image evaluations for primary or key secondary endpoints, the methods to monitor reader performance are all too often mired in the legacy use of adjudication rates. If misused, this simple metric can be misleading and sometimes entirely contradictory. Furthermore, attempts to overcome the limitations of adjudication rates using de novo or ad hoc methods often ignore well-established research conducted over the last half-century and can lead to inaccurate conclusions or variable interpretations. Underperforming readers can be missed, expert readers retrained, or worse, replaced. This paper aims to standardize reader performance evaluations using proven statistical methods. Additionally, these methods will describe how to discriminate between scenarios of concern and normal medical interpretation variability. Statistical methods are provided for inter-reader and intra-reader variability and bias, including the adjudicator's bias. Finally, we have compiled guidelines for calculating correct sample sizes, considerations for intra-reader memory recall, and applying alternative designs for independent readers.

Radiologists and Clinical Trials: Part 1 The Truth About Reader Disagreements.

The debate over human visual perception and how medical images should be interpreted have persisted since X-rays were the only imaging technique available. Concerns over rates of disagreement between expert image readers are associated with much of the clinical research and at times driven by the belief that any image endpoint variability is problematic. The deeper understanding of the reasons, value, and risk of disagreement are somewhat siloed, leading, at times, to costly and risky approaches, especially in clinical trials. Although artificial intelligence promises some relief from mistakes, its routine application for assessing tumors within cancer trials is still an aspiration. Our consortium of international experts in medical imaging for drug development research, the Pharma Imaging Network for Therapeutics and Diagnostics (PINTAD), tapped the collective knowledge of its members to ground expectations, summarize common reasons for reader discordance, identify what factors can be controlled and which actions are likely to be effective in reducing discordance. Reinforced by an exhaustive literature review, our work defines the forces that shape reader variability. This review article aims to produce a singular authoritative resource outlining reader performance's practical realities within cancer trials, whether they occur within a clinical or an independent central review.

US FDA draft Guidance Standard for Clinical Trial Imaging Endpoints: more than just imaging?

The current cost of developing a successful drug is typically over a billion dollars, with the registration trial(s) determining the success or failure of the entire development program. Often the primary endpoint of these trials is a subjective assessment. For registration trials with subjective endpoints, a regulatory agency may require a blinded independent central review (BICR) of the trial data. The BICR is a mechanism to reduce bias in open-labeled trials and to potentially increase accuracy and precision. A decision tree algorithm has been developed that can be used to determine when and what type of a BICR is needed. The US FDA draft Guidance Standard for Clinical Trial Imaging Endpoints can be used as an effective process map in exploring the value and use of BICRs in imaging, and in any hard to interpret variable subjective assessment in general.

Detection of coronary artery disease with perfusion stress echocardiography using a novel ultrasound imaging agent: two Phase 3 international trials in comparison with radionuclide perfusion imaging.

AIMS: To determine if perfusion stress echocardiography (PSE) with Imagify (perflubutane polymer microspheres) is comparable to stress perfusion imaging using (99m)Tc single photon emission computed tomography (SPECT) for coronary artery disease (CAD) detection. PSE is a novel technique for evaluating myocardial perfusion. RAMP (real-time assessment of myocardial perfusion)-1 and -2 were international, Phase 3 trials that evaluated the ability of PSE with Imagify, to detect CAD. METHODS AND RESULTS: Chronic, stable, chest pain patients (n=662) underwent Imagify PSE and gated SPECT imaging at rest and during dipyridamole stress. Independent blinded cardiologists [three PSE readers per trial, and four SPECT readers (one for RAMP-1, three for RAMP-2)] interpreted images. CAD was defined by quantitative coronary angiography or 90-day outcome with clinical review. Accuracy, sensitivity, and specificity were evaluated using non-inferiority analysis (one-sided alpha=0.025) compared with SPECT. SPECT results for RAMP-1 and -2 were: accuracy (70%, 67%), sensitivity (78%, 61%), and specificity (64%, 76%). Accuracy of all six PSE readers was non-inferior to SPECT (66-71%, P

Phase I and pharmacokinetic study of AI-850, a novel microparticle hydrophobic drug delivery system for paclitaxel.

PURPOSE: AI-850, paclitaxel in a novel polyoxyethylated castor oil-free hydrophobic microparticle delivery system, is being developed based on its favorable preclinical safety and antitumor activity profiles. The objectives of the study were to assess the feasibility and safety of administering AI-850 as a <30-min i.v. infusion without premedication every 3 weeks, determine the maximum tolerated dose and the phase II recommended dose of AI-850, study the pharmacokinetics of paclitaxel in this new formulation, and seek evidence of anticancer activity. EXPERIMENTAL DESIGN: This was an open-label phase I dose escalation study of AI-850 in patients with advanced solid malignancies. AI-850 doses were escalated according to a modified Fibonacci scheme. Clinical and laboratory toxicity was monitored, and paclitaxel plasma concentrations were measured by liquid chromatography-tandem mass spectrometry. RESULTS: Twenty-two patients received 56 courses of AI-850 at five dose cohorts ranging from 36 to 250 mg/m(2). Grade 4 neutropenia, either exceeding 5 days or complicated by fever, was dose limiting in two of six patients at 250 mg/m(2) AI-850. Three patients experienced grade 2 to 4 infusion-related adverse reactions. Toxicities, including fatigue, alopecia, nausea and vomiting, neuropathy, anorexia, and myalgia, were mild to moderate, reversible, and not dose related. Pharmacokinetics of free and total paclitaxel showed biexponential plasma decay and dose proportionality for maximum plasma paclitaxel concentration and area under the concentration versus time curve. Antitumor activity was documented in two patients with endometrial and tongue carcinomas. CONCLUSIONS: The administration of AI-850 as a brief infusion once every 3 weeks was feasible at doses up to 205 mg/m(2). The potential of AI-850 as an alternative to other approved paclitaxel formulations requires further clinical evaluation.

Measurement of radial artery contrast intensity to assess cardiac microbubble behavior.

OBJECTIVES: We sought to determine whether analysis of the contrast signal from the radial artery is better able to reflect changes in left ventricular (LV) microbubble dynamics than the signal from the LV itself. BACKGROUND: Assessment of microbubble behavior from images of the LV may be affected by attenuation from overlying microbubbles and nonuniform background signal intensities. The signal intensity from contrast in a peripheral artery is not affected by these artifacts and may, thus, be more accurate. METHODS: After injection of a contrast bolus into a peripheral vein, signal intensity was followed simultaneously in the LV and radial artery. The measurements were repeated using continuous, triggered, low and high mechanical index harmonic imaging of the LV. RESULTS: Peak and integrated signal intensities ranged from 25 dB and 1550 dB/s, respectively, with radial artery imaging to 5.6 dB and 471 dB/s with ventricular imaging. Although differences in microbubble behavior during the different imaging protocols could be determined from both the LV and radial artery curves, analysis of the radial artery curves yielded more consistent and robust differences. CONCLUSIONS: The signal from microbubbles in the radial artery is not affected by shadowing and is, thus, a more accurate reflection of microbubble behavior in the LV than the signal from the LV itself. This may have important implications for the measurement of myocardial perfusion by contrast echocardiography.

Evaluation of a new ultrasound contrast agent (AI-700) using two-dimensional and three-dimensional imaging during acute ischemia.

BACKGROUND: A new intravenous contrast agent, AI-700, was evaluated to determine whether a bolus injection could be used to detect myocardial perfusion abnormalities during acute ischemia by using 2-dimensional (2D) and 3-dimensional (3D) myocardial contrast echocardiography. METHODS: 2D MCE was performed in 14 closed-chest dogs during coronary occlusion by using both continuous and triggered gray scale harmonic imaging and triggered power Doppler imaging. 3D MCE (open-chest) and nuclear perfusion imaging were performed in 10 of the 14 dogs. Postmortem triphenyl tetrazolium chloride (TTC) staining was performed to verify infarction. RESULTS: Thirteen of the 14 dogs had infarct by TTC; all 10 that had nuclear imaging showed a perfusion defect. Of the 13 dogs that had infarction, perfusion defects were detected in all (13 of 13) by gray scale harmonic imaging (sensitivity = 100%), and in 11 of 13 by power Doppler imaging (sensitivity = 85%). All 10 dogs that had nuclear imaging showed perfusion defects by gray scale harmonic imaging (sensitivity = 100%) and 8 of 10 by power Doppler imaging (sensitivity = 80%). The perfusion defect size, derived from 3D imaging (25% +/- 12%) correlated well with that from nuclear imaging (24% +/- 12%) (y = 0.9x + 3.8, r = 0.96, mean difference = 1.3% +/- 2.6%). The perfusion defect mass by 3D (22 +/- 14 g) also correlated well with the infarct mass by TTC staining (24 +/- 16 g) (y = 0.8x + 2.9, r = 0.89, P <.001, mean difference = -2.8 +/- 7.6 g). CONCLUSION: After a single bolus of AI-700, both 2D and 3D MCE could accurately detect perfusion defects representing the area at risk of infarction during acute ischemia compared with nuclear imaging and predicted the size of infarction as verified by TTC staining.

The effect of a phosphodiester linking group on albumin binding, blood half-life, and relaxivity of intravascular diethylenetriaminepentaacetato aquo gadolinium(III) MRI contrast agents.

Amphiphilic gadolinium complexes were investigated as potential magnetic resonance imaging (MRI) contrast agents. A series of complexes was synthesized in order to study the effect of hydrophilic phosphodiester groups on albumin binding, relaxivity, and blood half-life in rats. Thus, compound 11a, a diethylenetriaminepentaacetato aquo gadolinium(III) (Gd-DTPA) derivative with an octyl substituent, was synthesized and compared to 5b, the analogous octyl derivative containing a phosphodiester linkage between the gadolinium chelate and the alkyl chain. Likewise, 11b, a naphthyl Gd-DTPA derivative, was compared to the naphthyl phosphodiester derivative 5c. A direct comparison is not available for 5a, a 4,4-diphenylcyclohexyl phosphodiester Gd-DTPA derivative; however, its pharmacokinetic properties mirror those of the other phosphodiester derivatives. Although the introduction of the phosphodiester moiety decreased log P by approximately 1.7 units, albumin binding data obtained in 4.5% human serum albumin (HSA) indicated that derivatives containing the phosphodiester group exhibited somewhat higher albumin affinity than their alkyl analogues (54 +/- 5 and 44 +/- 4% for 5b and 11a, respectively; 40 +/- 4 and 30 +/- 3% for 5c and 11b, respectively). Both classes of agents were characterized by enhanced relaxivity in the presence of 4.5% HSA (r1 = 16-42 mM(-1) s(-1) at 20 MHz and 37 degrees C) as compared with the relaxivity values measured in phosphate-buffered saline (PBS) alone (r1 = 4.6-6.6 mM(-1) s(-1) at 20 MHz and 37 degrees C). Pharmacokinetic data indicated that compound 5b had a half-life of 14.3 +/- 1.8 min in the rat as compared with a half-life of 6.20 +/- 0.04 min for the non-phosphodiester analogue 11a. Similarly, the half-life obtained for the phosphodiester 5c was 14.3 +/- 1.7 min as compared with a half-life of 6.80 +/- 0.03 min for 11b. The percent biliary excretion was significantly lower for the phosphodiester compounds than for non-phosphodiester analogues (17.7 +/- 4.0 and 66.9 +/- 3.4% for 5b and 11a, respectively; 17.0 +/- 1.6 and 64.3 +/- 9.0% for 5c and 11b, respectively). The percent biliary excretion (15.8 +/- 4.4%) and plasma half-life in the rat (23.1 +/- 2.9 min) for 5a are consistent with the extended plasma half-life of the other phosphodiester derivatives. Taken together, the enhanced relaxivity and extended blood half-life of the phosphodiester derivatives support the concept of using endogenous albumin binding to achieve blood pool-like properties for small-molecule magnetic resonance imaging (MRI) contrast agents.